Context and Connectionist Networks Mikael Bodén
نویسنده
چکیده
The question whether connectionism offers a new way of looking at the cognitive architecture, or if its main contribution is as an implementational account of the classical (symbol) view, has been extensively debated for the last decade. Of special interest in this debate has been to achieve tasks which easily can be explained within the symbolic framework, i.e., tasks which seemingly require the possession of a systematicity of representation and process, in a novel way in connectionist systems. In this paper we argue that connectionism can offer a new explanational framework for aspects of cognition. Specifically, we argue that connectionism can offer new notions of compositionality, content and context-dependence based on connectionist primitives, i.e., architectures, learning, weights and internal activations, which open up for new variations of systematicity.
منابع مشابه
Semantic systematicity and context in connectionist networks
Fodor and Pylyshyn argued that connectionist models could not be used to exhibit and explain a phenomenon that they termed systematicity, and which they explained by possession of compositional syntax and semantics for mental representations and structure sensitivity of mental processes. This inability of connectionist models, they argued, was particularly serious since it meant that these mode...
متن کاملEvolving context-free language predictors
Recurrent neural networks can represent and process simple context-free languages. However, the diiculty of nding with gradient-based learning appropriate weights for context-free language prediction motivates an investigation on the applicability of evolutionary algorithms. By empirical studies , an evolutionary algorithm proves to be more reliable in nding prediction solutions to a simple CFL...
متن کاملOn learning context-free and context-sensitive languages
The long short-term memory (LSTM) is not the only neural network which learns a context sensitive language. Second-order sequential cascaded networks (SCNs) are able to induce means from a finite fragment of a context-sensitive language for processing strings outside the training set. The dynamical behavior of the SCN is qualitatively distinct from that observed in LSTM networks. Differences in...
متن کاملThe Proper Treatment of Semantic Systematicity
Connectionist-minded philosophers, including Clark and van Gelder, have espoused the merits of viewing hiddenlayer, context-sensitive representations as possessing semantic content, where this content is partially revealed via the representations' position in vector space. In recent work, Bodén and Niklasson have incorporated a variant of this view within their conception of semantic systematic...
متن کاملA Connectionist Variation of Inheritance
A connectionist architecture is outlined which makes use of RAAM to generate representations for objects in inheritance networks and extended learning to make such representations context-sensitive. The architecture embodies inheritance quite diierently by relying on associative similarities and regions in representational space. The model avoids many of the problems identiied for traditional i...
متن کامل